STABILITY IS NOT OPEN 
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Abstract. We give an example of a symplectic manifold with a stable hypersurface 
such that nearby hypersurfaces are typically unstable. 



1. Introduction 

A closed hypersurface E in a symplectic manifold (M, Q) is called stable if a neigh- 
bourhood of E can be foliated by hypersurfaces whose characteristic foliations are 
conjugate. Here the characteristic foliation on a hypersurface E is defined by the 1- 
dimensional distribution ker(f2|E). Stability was introduced in [12] as a condition on 
hypersurfaces for which the Weinstein conjecture can be proved. More recently, it has 
attained importance as the condition needed for the compactness results underlying 
Symplectic Field Theory [3 [21 E] and Rabinowitz Floer homology [31 H]. 

Let us consider, in a fixed symplectic manifold (M, the space TCS of closed 
hypersurfaces equipped with the C°°-topology and its subset SHS of stable hyper- 
surfaces. It is easy to see that SHS is not closed: For example, the horocycle flow 
on a hyperbolic surface defines a hypersurface which is unstable but the smooth limit 
of stable ones; see [4j for many more examples. On the other hand, STiS contains 
open components, e.g. those corresponding to hypersurfaces of contact type. This 
prompted the question whether the set SHS is actually open in HS. The result of 
this paper shows that this is not the case. 

Theorem 1.1. There exists a stable closed hypersurface in a symplectic 6-manifold 
such that nearby hypersurfaces are typically unstable in the following sense: There 
exists a neighbourhood of E in TiS which contains an open dense set consisting of 
unstable hypersurfaces. 

The theorem continues to hold if the topology is replaced by the C'^ topology 
for some k > 2 and hypersurfaces are only assumed to be of class C'^. 

The theorem can be rephrased in terms of stable Hamiltonian structures [21 [5l [6]. 
A two-form u on an odd- dimensional manifold E is called a Hamiltonian structure if 
it is closed and maximally nondegenerate in the sense that its kernel distribution is 
one-dimensional. It is called stable if there exists a one-form A such that A|ker<^ 7^ 
and kera; C ker ciA. Then a hypersurface E in a symplectic manifold (M, Q) is stable 
iff n Is defines a stable Hamiltonian structure, and every stable Hamiltonian structure 
arises as a stable hypersurface in some symplectic manifold [5]. Now Theorem II. II can 
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be rephrased as follows: There exists a stable Hamiltonian structure u on a closed 
5-nianifold S such that nearby Hamiltonian structures with the same cohomology 
class as u are typically unstable. 

Theorem 11.11 has implications on the foundations of holomorphic curve theories 
such as Symplectic Field Theory [3 [21 E] and Rabinowitz Floer homology [3],|1]. For 
the construction of those theories one needs to perturb a given stable Hamiltonian 
structure to make all closed characteristics nondegenerate. Theorem 11.11 suggests 
that such a perturbation may not be possible within the class of stable Hamiltonian 
structures (see also [6J for a result pointing in the same direction). In Rabinowitz 
Floer homology this problem can be overcome in the following way [1]: One chooses 
an additional Hamiltonian perturbation of the Rabinowitz action functional. For a 
generic small perturbation the Rabinowitz action functional becomes Morse, but for 
the perturbed action functional one might lose compactness. However, one can still 
define a boundary operator by taking into account only gradient flow lines close to 
the original ones. We wonder if a similar strategy can be applied to SFT as well. 

2. Preliminaries on Anosov Hamiltonian structures 

Anosov Hamiltonian structures. Recall that the flow (pt of a vector field F on a 
closed manifold S is Anosov if there is a splitting TS = MF © F'^ © and positive 
constants A and C such that for all a; G S 

\dxMv)\ < Ce"^>| for v e and t > 0, 

\d^(j)-t{v)\ < Ce-^'\v\ for v e E"" and t > 0. 

If an Anosov vector field F is rescaled by a positive function its flow remains Anosov [H 
[I5] . It will be useful for us to know how the bundles E^ and E"^ change when we 
rescale F by a smooth positive function r : S — > M.^. Let (j) be the flow of rF and F^ 
its stable bundle. Then (cf. [T5] ) 

(1) E'{x) = {v + z{x,v)F{x) : v E E'{x)}, 

where z{x,v) is a continuous 1-form (i.e. linear in v and continuous in x). Moreover, 
if we let / = l{t,x) be (for fixed x) the inverse of the diffeomorphism 

t r{(f)s{x))^^ ds 

Jo 

then 

(2) d(i)t{v + z{x, v)F{x)) = d(f)i{v) + z{(j)i{v), d(f)i{v))F{(j)i{x)). 

This shows that for closed S the flow (pt is again Anosov. There is a similar expression 
for F". It is clear from the discussion above that the weak bundles RF © F'^ and 
MF © F" do not change under rescaling of F (the strong bundles F'^'" are indeed 
affected by rescaling as we have just seen). 

Let {Ti,uj) be a Hamiltonian structure. We say that the structure is Anosov if the 
flow of any vector field F spanning ker u is Anosov. 
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We say that an Anosov Hamiltonian structure satisfies the 1/2-pinching condition 
or that it is 1-bunched P, (TU] if for any vector field F spanning keru; with flow (pt 
there are functions fif,fis '■ S x IR+ — > ]R_|_ such that 

• linii^oo sup^.gs 7I7(^ - U, 

• iif{x,t)\v\ < \d(f)t{v)\ < fis{x,t)\v\ for all X G S, t > and v G E'^{x), and 
lif{x,t)\v\ < < fis{x,t)\v\ for all a; G S, t > and v G E'^[(j)tx). 

We remark that the 1/2-pinching condition is invariant under rescaling. Indeed, 
consider the flow (f)t of rF. It is clear from ([1]) and ([2]) that there is a positive 
constant n such that 

—^,f{x,l{t,x))\v\ < \d(j)t{v)\ < Kfis{x,l(t,x))\v\ 

for t > and v G E^ (with a similar expression for E"^). We know that given e > 0, 
there exists T > such that for all x G S and alH > T we have 

fifix,t) 

On the other hand, there exists a > such that l{t, x) > at for all x G S and t > 0. 
Hence, if we choose t > T/a we have 

Hs{x,l{t,x)f ^ ^ 
fif{x, l(t, x)) 

for all X G S. Therefore 

/i,(x,/(t,x))2 
lim sup — r— = (J 

*^°OxgS /i/(x, /(t,x)) 

and thus 0i is also 1/2-pinched. 

Hence the Anosov property as well as the 1/2-pinching condition are invariant under 
rescaling and thus intrinsic properties of the Hamiltonian structure. One of the main 
consequences of the 1/2-pinching condition is that the weak bundles M.F © i?* and 
RF © are of class ^ Theorem 5] (see also fTT]). 

Stable Anosov Hamiltonian structures. Suppose now (S, u) is a stable Anosov 
Hamiltonian structure satisfying the 1/2-pinching condition. Let A be a stabilizing 
1-form and R the Reeb vector field defined by inu = Aq and A(-R) = 1. Invariance 
under the flow implies that u and A both vanish on E'^ and E"^. Since the flow (pt of 
R is Anosov and E'®E'^ = ker A which is it follows that E' = ker A n (MF © E^) 
and E'" must be C^. Under these conditions we can introduce the Kanai connection 
[13] which is defined as follows. 

Let I be the (1, l)-tensor on S given by /(f) = —v for v G -E*, I{v) = v for v G E^ 
and I{R) = 0. Consider the symmetric non-degenerate bilinear form given by 

h{X, Y) := uj{X, IF) + A © A(X, Y). 

The pseudo-Riemannian metric h is of class and thus there exists a unique C° 
affine connection V such that: 

(1) h is parallel with respect to V; 
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(2) V has torsion uj ® R. 

This connection has the following desirable properties [H [13] : it is invariant under 0t 
and the Anosov splitting is invariant under V: if X is any section of E'^'^, V^X G E'^'^ 
for any v. 

The other good consequence of the 1/2-pinching condition, besides smoothness 
of the bundles, is the following lemma (cf. [T^ Lemma 3.2]). 

Lemma 2.1. V(c/A) = 0. 

Proof. Suppose r is any invariant (0, 3)-tensor annihilated by R. We claim that r 
must vanish. To see this, consider for example a triple of vectors {vi,V2,Vs) where 
vi,V2 G E^ but Vs G -E"*. Then there is a constant C > such that for all t > 

\Tx{Vi,V2,V3,)\ = \T^tx{d(f)t{vi),d(f)t{v2),d(f)t{v3))\ 
< Cfls{x,tfflf{x,t)~^\vi\\v2\\v3\. 

By the 1/2-pinching condition the last expression tends to zero as t — > oo and therefore 
'Txivi,V2,V3) = 0. The same will happen for other possible triples {vi,V2,V3) when we 
let t — > ±00. 

Since dX and V are 0t-invariant, so is V{dX). Since i^dX = 0, V{dX) is also 
annihilated by R (to see that VnldX) = use that dX is 0t-invariant and that V_r = 
Lji). Hence by the previous argument applied to r = V{dX) we conclude that V{dX) = 
as desired. □ 



Quasi-conformal Anosov Hamiltonian structures. Let 0* be an Anosov flow 
on S endowed with a C°-Riemannian metric. Consider the following functions on 
E X M: 

K'{x,t) 



max{ d(f)t 


iv)\ 


: V e E'^i 


:^), 


\v\ 


= 1} 


mm{\d(t)t( 


y)\ 


: V e E^ 


x), 


\v\ 


= 1}' 


max{ 


{v)\ 


: V e E"" 


(^), 


\v\ 


= 1} 


mm{\d(f)t( 


v)\ 


: V e E^'i 




\v\ 





The flow (pt is said to be quasi-conformal if and K'^ are both bounded on S x M. 
This property is clearly independent of the choice of Riemannian metric used to define 
K'^ and K^. Moreover it is shown in flEl Proposition 3.5] that quasi-conformality is 
independent of times changes, thus it makes sense to talk about quasi-conformal 
Anosov Hamiltonian structures. The next theorem will be useful for us. 

Theorem 2.2 ([H], Theorems 1.3 and 1.4). Let (pt be a topologically mixing Anosov 
flow with dimE'^ > 2 and dimE^ > 2. If (pt is quasi-conformal, then the weak bundles 
are C°°. 

Recall that (pt is topologically mixing if for any two nonempty open sets U and V in 
S, there is a compact set i^' C M such that for every t & 'R\K we have (pt{U) fl V 7^ 0. 
Recall also that (pt is said to be transitive if there is a dense orbit. Our Anosov flows 
will always be transitive since they preserve a smooth volume form [14^ Chapter 18]. 
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3. A THEOREM 

Theorem 3.1. Let {T,,uj) be a 1/2-pinched Anosov Hamiltonian structure with [uj] ^ 
0, hut [cu^] = 0. Suppose in addition that S fibres over a closed 3-manifold with fibres 
diffeomorphic to S"^ and transversal to the weak subbundles. Then, if {T,,uj) is stable, 
the weak subbundles must be . 

Proof. The proof of this theorem is very much inspired by the proof of Theorem 2 in 
^13j . We first make the foUowing observation: 

• E'^ (-E"") cannot contain a nontrivial proper continuous subbundle. 
Indeed since Ri^SE"" is transversal to the fibres of the fibration E — >■ M by 2-spheres, 
we can write TS = V® Mi? © where V is the vertical subbundle of the fibration. 
Using this splitting we may define an isomorphism E^ ^ V and since the tangent 
bundle of S'^ does not admit a nontrivial proper continuous subbundle, the same holds 
for E' (and E"). 

Next we observe that the stabilizing 1-form A cannot be closed. Indeed, write 
uj'^ = dr and note that if A was closed, then the volume form X A dr would be exact, 
which is absurd. 

Since u is non-degenerate, there exists a smooth bundle map L : E'^(BE^ E^^BE"^ 
such that for sections X, Y oi E'' ® E"^ 

dX{X, Y) = uj{LX, Y) = uj{X, LY). 

The map L is invariant under 0^ and preserves the decomposition E'^ © E^, i.e. 
L = + L^, where U : E^ ^ E^ and : E'^ ^ E^. In particular, L commutes 
with /. By Lemma 12.11 the 1/2-pinching condition implies that V{dX) = and 
thus L is parallel with respect to V. Note that by transitivity of (pt, the characteristic 
polynomial of is independent of x G E. Let p G C be an eigenvalue of L'^. Consider 
y4 := — 3fJ(p)Id. Note that A cannot be zero: Otherwise dX = cuj for a constant 
c G M; since A is not closed, c 7^ 0, which in turns implies [uj] = 0, contradicting the 
hypotheses of the theorem. 

Clearly A'^ has p := — 3(p)^ as an eigenvalue. Let H (Z E'^ denote the eigenspace 
of the eigenvalue p. Since is parallel it has the same dimension at every point 
a; G S and since E'^ cannot contain a nontrivial proper continuous subbundle, we 
deduce that H = E^. Hence A"^ = pid. Moreover p 7^ 0, otherwise kerA would be a 
nontrivial proper continuous subbundle of E^. Therefore we have proved that 

r := ^JL^ - K(p)Id), 

defines a parallel almost complex structure on E'^ of class invariant under (pt. 
Similarly we obtain an almost complex structure J" on E"^. 

Now choose a Riemannian metric on E'^ (resp. E"^) which is invariant under J* 
(resp. J"). By declaring E^, E^ and Mi? orthogonal and R with norm 1, we obtain a 
metric (of class C^) on E such that with respect to this metric 



max{ (i0t(t>) : v G E^{x), 


\v 


1 = 1} 


min{ (i0f(f ) : v G E'^{x), 


v\ 


= 1} 



= 1, 
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for all t G M and a; G S. This is because 0^ preserves J'* and E'^ has rank two. 
Similarly for E^. This shows that {T,,uj) is a quasi-conformal Anosov Hamiltonian 
structure. 

Finally we note that if a transitive Anosov flow is not topologically mixing, then 
by a theorem of J. Plante [17] it must be a suspension with constant return function. 
In particular, this implies that there is a closed 1-form f3 such that f3{R) > 0. The 
same argument above that proved that A cannot be closed shows that such a f3 cannot 
exist. Hence (pt is topologically mixing and by Theorem 12.21 the weak bundles must 
be □ 

Remark 3.2. Note that the proof above only requires A to be of class C^. 

4. The example 

Let r be a discrete group of isometrics of such that M := F \ is a closed 
orientable hyperbolic 3-manifold. We consider the geodesic flow acting on the unit 
sphere bundle SM and let a be the canonical contact 1-form. 

The space of invariant 2-forms of the geodesic flow of M = F \ has dimension 
two [131 Claim 3.3]. It is spanned by the 2-form da, where a is the canonical contact 
form on the unit sphere bundle SM, and the following additional 2-form ip which 
we now describe. Given a unit vector v G T^M.^, let i{v) : T^EI^ T^M.^ be the 
linear map defined by i{v){v) = and i{v) rotates vectors in {f }"*" by tt/2 according 
to the orientation of H^. Any vector ^ G T^SM^ can be written as ^ = {^h,^v) 
with the usual identification of horizontal and vertical components (cf. [16]). Define 

: T^Sm^ T^SB.^ as 

(3) MCH,Cv) = {^{v)^v,^{v)^H). 
Then 

(4) ^jJ^{^, 7]) := da^{Jy^, r]) = {i{v)^v, Vv) - {i{v)^H, Vh)- 

Clearly this construction descends to SM where we use the same notation a, etc.) 
In a moment we will check that ip is invariant under (pt, but before we do so, let us 
describe the stable and unstable bundles of (pt and the action of d(pt on them. Recall 
that dcpti^H, ^v) = 0^{t), '^(t)) where Y is the unique Jacobi field (along the geodesic 
TT(pt{v), where vr : SM — > M is foot-point projection) with initial conditions {^h,^v)- 
Solving the Jacobi equation Y — Y = we find: 

^""i^) = {("^7 -'^) ■ w J-v}, 
E"(f) = {{w,w) : w ±v}. 
Note that J leaves E^ and E^ invariant. Moreover 

d(pt{w, -w) = e"*(e„(t), -e^(t)), 

d(pt{w,w) = e\e^{t),e^{t)), 

where e^(t) is the parallel transport of w along the geodesic iKptiy). Since ei(,,)u,(t) = 
i{Ti(p)tv)ew{t) we see that d(p)t preserves J. Since da is also (pt invariant, it follows that 
ip is invariant. Note that iRip = for the Reeb vector field R of a. 



7 



Lemma 4.1. The invariant 2-form ip is dosed hut not exact. The 4-form ip"^ is exact 
and (SMjip) is a stable Hamiltonian structure with stabilizing 1-form a and Reeb 
vector field R. 

Proof. The 3-form dip is invariant under (pt and is annihilated by R. Then the proof 
of Lemma Em shows that dip = (obviously (pt is 1/2-pinched). In order to show that 
[ip] 7^ 0, consider the 2-sphere of unit vectors in T^M.^. A tangent vector ^ G T^S^ 
has the form ^ = {0,w) where w -L v. If we take two tangent vectors ^ = {0,w), 
rj = (0, u) G TyS^, from and (jl]) we see that 

i^v{^,v) = {i{v)w,u). 

This implies that 



and thus [ip] ^ 0. Consider now the invariant 4-form ip"^ and the invariant 5-form 
aAip'^. By transitivity, there is a constant k such that aAip'^ = k aA((ia)^. Contracting 
with R we see that ip"^ must be k (da)"^ and therefore exact. Finally, it is immediate 
from the definition of ip that its restriction to E'"^ © E"^ = ker a is non-degenerate. 
Hence {SM, ip) is a Hamiltonian structure with stabilizing 1-form a and Reeb vector 
field R. □ 

Now let X := SM x [—e,e) and r : X — >■ SM the obvious projection. Define 
ux '■= d{rT*a) + T*ip, where r G {—e,e). For e small enough {X,ux) is a symplectic 
manifold and r = is the stable hypersurface {SM,ip). 

We have now come to our main result which implies Theorem 11.11 in the introduc- 
tion. 

Theorem 4.2. A typical hypersurface S C X near SM is not stable. 

Proof. Consider a hypersurface E near r = and let u be Ux restricted to S. By 
Lemma 14.11 [u] ^ 0, but [u^] = 0. Since SM fibres over M with fibres given by 
2-spheres transveral to the weak bundles the same holds true for E (recall that under 
perturbations the stable and unstable bundles vary continuously). Finally we note 
that (S,C(j) is 1/2-pinched. Indeed, recall that for the geodesic flow of M, we have 

|#t(OI = e-*|el for eGi?^ 

|rf0,(O|=e*|e|foreeE^ 
Thus for a flow ipt which is close to (pt we get 

^|e|e-^* < < Cl^le-"' fore e E^ and t > 0, 

^|e|e"^* < \difi^tiO\ < Cieie-'^* for ^ G and t > 0, 

where all the constants C,A,a are close to 1. Thus (S,c<j) is 1/2-pinched. 

We can now apply Theorem 13.11 to conclude that if S near r = is stable, then 
the weak bundles must be C°°. However, a theorem of Hasselblatt [91, Corollary 1.10] 
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asserts that an open and dense set of symplectic Anosov systems does not have weak 
bundles of class C^~^. Thus a typical hypersurface S near r = cannot be stable. □ 

Remark 4.3. It is possible to prove the last theorem without appealing to Theorem 
12.21 An inspection of the proof of Theorem 13.11 shows that since d(j)t preserves J, all 
the closed orbits are actually 2-bunched in the terminology of [9], and the local per- 
turbation argument in |9l Section 4] implies that an open and dense set of symplectic 
Anosov systems does not have all closed orbits being 2-bunched (this fact is actually 
used in the proof of [9, Corollary 1.10] quoted above). Of course, the conclusion of 
Theorem 13.11 is stronger if we use Theorem 12.21 
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